Search results

1 – 4 of 4
Open Access
Article
Publication date: 29 November 2022

Lonneke H. Schellekens, Marieke F. van der Schaaf, Cees P.M. van der Vleuten, Frans J. Prins, Saskia Wools and Harold G.J. Bok

This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in…

1795

Abstract

Purpose

This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education.

Design/methodology/approach

The application was developed using a design-based research (DBR) methodology. The application’s design was informed by a literature search and needs assessment of quality assurance stakeholders to ensure compliance with daily practices and accreditation requirements. Stakeholders from three study programmes evaluated the application.

Findings

As part of the development of the application, module- and programme-level dashboards were created to provide an overview of the programme’s outcomes, assessment methods, assessment metrics, self-evaluated quality indicators and assessment documents. The application was evaluated by stakeholders at the module and programme levels. Overall, the results indicated that the dashboards aided them in gaining insight into the assessment programme and its alignment with underlying assessments.

Practical implications

Visualisation of the assessment programme’s structure and content identifies gaps and opportunities for improvement, which can be used to initiate a dialogue and further actions to improve assessment quality.

Originality/value

The application developed facilitates a cyclical and transparent assessment quality assurance procedure that is continuously available to various stakeholders in quality assurance.

Details

Quality Assurance in Education, vol. 31 no. 2
Type: Research Article
ISSN: 0968-4883

Keywords

Article
Publication date: 25 January 2013

Marjan J.B. Govaerts, Margje W.J. van de Wiel and Cees P.M. van der Vleuten

This study aims to investigate quality of feedback as offered by supervisor-assessors with varying levels of assessor expertise following assessment of performance in residency…

2893

Abstract

Purpose

This study aims to investigate quality of feedback as offered by supervisor-assessors with varying levels of assessor expertise following assessment of performance in residency training in a health care setting. It furthermore investigates if and how different levels of assessor expertise influence feedback characteristics.

Design/methodology/approach

Experienced (n=18) and non-experienced (n=16) supervisor-assessors with different levels of assessor expertise in general practice (GP) watched two videotapes, each presenting a trainee in a “real-life” patient encounter. After watching each videotape, participants documented performance ratings, wrote down narrative feedback comments and verbalized their feedback. Deductive content analysis of feedback protocols was used to explore quality of feedback. Between-group differences were assessed using qualitative-based quantitative analysis of feedback data.

Findings

Overall, specificity and usefulness of both written and verbal feedback was limited. Differences in assessor expertise did not seem to affect feedback quality.

Research limitations/implications

Results of the study are limited to a specific setting (GP) and assessment context. Further study in other settings and larger sample sizes may contribute to better understanding of the relation between assessor characteristics and feedback quality.

Practical implications

Findings suggest that even with supervisor-assessors with varying levels of assessor expertise who are trained in performance assessment and the provision of performance feedback, high-quality feedback is not self-evident; coaching “on the job” of feedback providers and continuous evaluation of feedback processes in performance management systems is crucial. Instruments should facilitate provision of meaningful feedback in writing.

Originality/value

The paper investigates quality of feedback immediately following assessment of performance, and links feedback quality to assessor expertise. Findings can contribute to improvement of performance management systems and assessments for developmental purposes.

Details

European Journal of Training and Development, vol. 37 no. 1
Type: Research Article
ISSN: 2046-9012

Keywords

Article
Publication date: 19 January 2010

Caroline F. Timmers and Cees A.W. Glas

The main purpose of this paper is to describe the development of an instrument designed to measure information‐seeking behaviour of undergraduate students during study assignments.

10560

Abstract

Purpose

The main purpose of this paper is to describe the development of an instrument designed to measure information‐seeking behaviour of undergraduate students during study assignments.

Design/methodology/approach

Literature research, internal consistency and reliability computed with Cronbach's Alpha (α), Factor Analyses with Varimax rotation, and item response theory form the approach to examining the subject.

Findings

Four scales were found within a 46‐item survey on information‐seeking behaviour: a ten‐item scale for applying search strategies (α=0.68), a 14‐item scale for evaluating information (α=0.74), a six‐item scale for referring to information (α=0.81) and a 12‐item scale for regulation activities when seeking information (α=0.75).

Originality/value

The four scales for information‐seeking behaviour can be used to monitor and evaluate this behaviour of students in higher education.

Details

Journal of Documentation, vol. 66 no. 1
Type: Research Article
ISSN: 0022-0418

Keywords

Article
Publication date: 9 August 2018

Alexandros Psychogios, Feim Blakcori, Leslie Szamosi and Nicholas O’Regan

The purpose of this paper is to explore and theorize the process of managerial feedback in relation to change in small and medium enterprises (SMEs).

Abstract

Purpose

The purpose of this paper is to explore and theorize the process of managerial feedback in relation to change in small and medium enterprises (SMEs).

Design/methodology/approach

This research embraces a qualitative methodology in the context of manufacturing SMEs. Drawing on 30 in-depth interviews, and observations conducted with various managers in six SMEs operating in three countries, it is argued that managers benefit more by using daily, ongoing, feedback as a trigger of change in their organizations.

Findings

The findings suggest that there is an overall view that managers appear to be reluctant to change existing processes using formalized feedback mechanisms, which runs counter-intuitive to the literature. In contrast, informal methods of feedback work better in enhancing organizational change. Moreover, another two features of feedback enhance this process, namely, benefits oriented and confidence oriented. As such, this study contributes to existing knowledge and practice by proposing a three-fold form of feedback through which managers expand their perspectives of feedback from feeding-back to feeding-forward thereby enhancing the opportunities of triggering change.

Research limitations/implications

Feedback should merely be considered as a dynamic and socially constructed managerial practice. A practice where actors not only exchange information and share knowledge, but also act, react and interact with each other as they constantly rethinking the change process. The proposed aspect of feedback emphasizes knowledge therapeutically and in combination with the dialogical discourse (practical illustration) that increases the odds for capturing change as a natural, rather than exceptional.

Practical implications

Practitioners, as such, may wish to consider the terminology used when it comes to studying change and its implementation in a crisis context. Using deformalized managerial feedback mechanisms to tackle a formal phenomenon like “change” could help avoid employees perceiving a negative connotation, causing resistance or confusion and feeling threatened. Therefore, the authors suggest that practitioners, during development initiatives on modernizing or altering organizational processes, consider replacing the term “change” as a formal concept.

Originality/value

It is an investigation from an exploratory perspective in studying and understanding the causes, factors and modalities that trigger managerial feedback toward organizational change in manufacturing SMEs.

Details

Journal of Small Business and Enterprise Development, vol. 26 no. 1
Type: Research Article
ISSN: 1462-6004

Keywords

1 – 4 of 4